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DETAILED ACTION 

This action is responsive to the response to the restriction requirement filed on September 
22, 2005. Claims 7-18, 22-27, and 31-34 are cancelled. Claims 1-6, 19-21 and 26-30 are 
pending. Claims 1-6, 19-21 and 26-30 represent a multi-modal communication method. 



Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

2. Claims 1-6, 19-21 and 26-30 rejected under 35 U.S.C. 102(e) as being anticipated by 
Boloker et al. US Patent Publication No. 2002/0194388. Boloker teaches the invention as 
claimed including method for implementing multi-modal browsing (see abstract). 



As per claim 1, Boloker teaches an apparatus for multi-modal communication 
comprising: 

a controller (the synchronization manager; pp 201); and 
at least one multi-modal session proxy server having a proxy address, wherein the controller 
determines, on a per session basis, a multi-modal proxy identifier representing the proxy address 
of the multi-modal session proxy server (the multi modal shell, Figure 24, pp 0073, 0090, 0201, 
0202,0206,0225). 

As per claim 2, Boloker teaches the apparatus of claim 1 further comprising: at least one 
browser having a per session multi-modal proxy evaluator and a browser proxy identifier, 
wherein the browser is operably coupled to the controller and the at least one multi-modal 
session proxy server such that the browser receives the multi-modal proxy identifier and the 
browser proxy identifier is evaluated by the multi-modal proxy evaluator, on a per session basis, 
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in response to the multi-modal proxy identifier (the multi-modal proxy evaluator is taught by the 
modal view controller (MVC )and the browser proxy ID is located in the wrapper (42a); 
Figures 23 and 25, pp. 0082, 0090, 0102, 0112, 0179-0186, 0207, 0252). 

As per claim 3, Boloker teaches the apparatus of claim 1 further comprising: 
at least one voice browser having a voice browser per session multi-modal proxy 
evaluator and a voice browser proxy identifier, wherein the voice browser is operably coupled to 
the controller and the at least one multi-modal session proxy server such that the voice browser 
receives the multi-modal proxy identifier and the voice browser proxy identifier is evaluated by 
the voice browser per session multi-modal proxy evaluator, on a per session basis, in response to 
the multi-modal proxy identifier (the browser is a voice browser which is connected to the MVC 
and the Multi-modal shell; pp 0183-0185, 0214, 0216); and 

at least one graphical browser having a graphical browser per session multi-modal proxy 
evaluator and a graphical browser proxy identifier, wherein the graphical browser is operably 
coupled to the controller and the at least one multi-modal session proxy server such that the 
graphical browser receives the multi-modal proxy identifier and the graphical browser proxy 
identifier is evaluated by the graphical browser per session multi-modal proxy evaluator, on a per 
session basis, in response to the multi-modal proxy identifier (the browser is a graphical browser 
(GUI) which is connected to the MVC and the Multi-modal shell; pp 0183-0185, 0214, 0216). 

As per claim 4, Boloker teaches the apparatus of claim 3 further comprising: 
at least one graphical browser multi-modal synchronization interface operably coupled to 
the graphical browser; at least one voice browser multi-modal synchronization interface operably 
coupled to at least one the voice browser (each browser has an interface manager; Figure 26 and 
28, pp 0092, 0183-0187, 0201, 0226, 0228); and 

at least one multi-modal synchronization coordinator operably coupled to the graphical 
browser multi-modal synchronization interface, the voice browser multi-modal synchronization 
interface and the multi-modal session proxy, wherein multi-modal session proxy server allows 
the multi-modal synchronization coordinator to synchronize the at least one graphical browser 
and the at least one voice browser (the browsers are synchronized by the interface manager and 
synchronization manager; Figure 26 and 28, pp 0092, 0183-0187, 0201, 0226, 0228). 

As per claim 5, Boloker teaches the apparatus of claim 4 further comprising: at least one 
information request provided by at least one of the at least graphical browser and the at least one 
voice browser to the multi-modal session proxy server whereby the multi-modal session proxy 
server fetches requested information from a content server (the MM shell gets information from 
the content server; Figure 26, pp 0082, 0092, 01 1 1, 01 12); and 

wherein if the requested information is provided to the at least one voice browser, the at least one 
graphical browser is updated via the at least one graphical browser multi-modal synchronization 
interface through the multi-modal synchronization coordinator and if the requested information 
is provided to the at least one graphical browser, the at least one voice browser is updated via the 
voice browser multi-modal synchronization interface through the multi-modal synchronization 
coordinator (the information is processed through a synchronization coordinated and MVC; 
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As per claim 6, Boloker teaches he apparatus of claim 1 wherein the controller further comprises 
at least one load balancer whereupon the controller determines the multi-modal proxy identifier 
in response to the at least one load balancer (pp 0109, 0226, 0245) 

As per claim 19, Boloker teaches a method for multi-modal communication comprising: 
receiving a multi-modal proxy identifier, on a per session basis, for a browser; evaluating, on a 
per session basis, a browser proxy identifier in response to receiving the multi-modal proxy 
identifier; and sending an information request via a multi-modal session proxy server identified 
by the multi-modal proxy identifier (the multi-modal proxy evaluator is taught by the modal 
view controller (MVC )and the browser proxy ID is located in the wrapper (42a); Figures 23 and 
25, pp. 0082, 0090, 0102, 0112, 0179-0186, 0207, 0252). 

As per claim 20, Boloker teaches the method of claim 19 further comprising: 
fetching requested information from at least one content server (the MM shell gets 
information from the content server; Figure 26, pp 0082, 0092, 01 1 1, 01 12); and 
providing the requested information to the browser (the information is processed through a 
synchronization coordinated and MVC; Figure 27, pp 0226-0228, 0230, 0241-0244). 

As per claim 21, Boloker teaches the method of claim 20 further comprising: prior to sending an 
information request, storing an updated browser proxy identifier in a memory location (pp 201, 
202,206,225). 

As per claim 28, Boloker teaches the method of claim 26 further comprising: prior to 
determining a multi-modal session proxy server, on a per session basis, initiating a multi-modal 
session between a terminal and a multi-modal network element (the multi-modal proxy evaluator 
is taught by the modal view controller (MVC )and the browser proxy ID is located in the 
wrapper (42a); Figures 23 and 25, pp. 0082, 0090, 0102, 01 12, 0179-0186, 0207, 0252). 

As per claim 29, Boloker teaches the method of claim 28 further comprising: evaluating, 
on a per session basis, a browser proxy identifier in response to receiving the multi-modal proxy 
identifier; and receiving an information request from the browser to the multi-modal session 
proxy server identified by the multi-modal proxy identifier (the multi-modal proxy evaluator is 
taught by the modal view controller (MVC )and the browser proxy ED is located in the wrapper 
(42a); Figures 23 and 25, pp. 0082, 0090, 0102, 01 12, 0179-0186, 0207, 0252). 

As per claim 30, Boloker teaches the method of claim 28 further comprising: 

fetching requested information from at least one content server (the MM shell gets 

information from the content server; Figure 26, pp 0082, 0092, 01 1 1, 01 12); and 

providing the requested information to the browser (the information is processed through 

a synchronization coordinated and MVC; Figure 27, pp 0226-0228, 0230, 0241-0244). 
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Conclusion 

3. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

4. Gbadegesin US Patent No. 6,754,709 

5. Nakazawa US Patent No. 6,643,778. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Uzma Alam whose telephone number is (571) 272-3995. The 
examiner can normally be reached on Monday-Tuesday 5:30 AM - 2:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ario Etienne can be reached on (571) 272-4001 . The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Uzma Alam 
Ua 

December 6, 2005 
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